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I. Basis of the report 

1 This report has been drawn on the basis of (substitute sheets which have been furnished to the receiving Office in 
response to an invitation under Article 14 are referred to in this report as "originally filed" and are not annexed to 
the report since they do not contain amendments.): 

Description, pages: 

1-5,7,8,10-21 as originally filed 

6,9 as received on 



15/11/1999 with letter of 



11/11/1999 



Claims, No.: 

1-10 



as received on 



15/11/1999 with letter of 



11/11/1999 



Drawings, sheets: 

1/6-6/6 as originally filed 

2. The amendments have resulted in the cancellation of: 

□ the description, pages: 

□ the claims, Nos.: 

□ the drawings, sheets: 

3. □ This report has been established as if (some of) the amendments had not been made, since they have been 

considered to go beyond the disclosure as filed (Rule 70.2(c)): 



4. Additional observations, if necessary: 
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V. Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial 
applicability; citations and explanations supporting such statement 



1. Statement 



Novelty (N) Yes: Claims 1-10 

No: Claims 

Inventive step (IS) Yes: Claims 

No: Claims 1-10 

Industrial applicability (IA) Yes: Claims 1 -1 0 

No: Claims 



2. Citations and explanations 



see separate sheet 



VI. Certain documents cited 



1. Certain published documents (Rule 70.10) 



and / or 

2. Non-written disclosures (Rule 70.9) 



see separate sheet 



VII. Certain defects in the international application 

The following defects in the form or contents of the international application have been noted: 
see separate sheet 

VIII. Certain observations on the international application 

The following observations on the clarity of the claims, description, and drawings or on the question 
claims are fully supported by the description, are made: 

see separate sheet 
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V. Reasoned statement 

1 . Reference is made to the following documents: 

D1 : US-A-5 608 730 (OSAKABE Y. ET AL) 4 March 1997 
D2: US-A-5 617 330 (STIRLING A.) 1 April 1997 
D3: US-A-5 499 018 (WELMER H.) 12 March 1996 
D4: US-A-5 617 571 (TANAKA S.) 1 April 1997 

D5: WO 97 05743 A (THOMSON CONSUMER ELECTRONICS INC.) 13 
February 1997 

2. Claim 1: 

Document D1 discloses a digital apparatus (10) comprising: 

(a) means for receiving (14) from a peripheral device (20), interconnected by a 
digital bus (1), data representative of an on-screen display associated with said 
peripheral device (see column 1, lines 7-16 and column 40, lines 4-11); 

(b) means for receiving (10a) a stream representative of a programmed event 
(see column 10, lines 20-26); and 

(c) means for combining (12), in said digital apparatus, said data received from 
said peripheral device and said stream to produce a signal representative of a 
combined displayable image (see column 18, lines 57-62). 

Similar prior art is also disclosed in D2 through D4. 

The claimed subject matter only differs from the disclosure of D1 to D4 in that the 
data is a bit-mapped data and in that the stream representative of a programmed 
event is a digital stream. Although not explicitly mentioned in any of documents 
D1-D4, these features nevertheless appear to be well known alternatives in the 
era of digital television. Besides, D1 refers to a "Data Attribute [...] for identifying 
ASCII code, [...] Japanese OSD data, [...] or the like" (see col. 13, lines 49-61) so 
that the use of bit-mapped data seems to be contemplated, which bit-mapped 
data is then to be combined with the digital stream in a straightforward way. 
Consequently, the subject matter of claim 1 is considered to lack an inventive 
step. 

3. Claim 7: 

Since it is also well known for a person skilled in the art of digital buses to use 
either of an asynchronous or an isochronous transfer mode, the same objection 
as to lack of inventive step likewise applies to this corresponding method claim. 
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4. Claim 10: 

As discussed earlier, document D1 indeed discloses a digital television apparatus 
(10) comprising: 

(a) means for receiving from a peripheral device (20), interconnected by a 
digital bus (1), data representative of an on-screen display associated with said 
peripheral device. 

Similar prior art is disclosed in D2 to D4. 

The subject matter of claim 10 further differs from the disclosure of D1 to D4 in 
that, in claim 10, data representative of an updated portion of the previously 
transferred data is transferred and indexed to said previously transferred data, 
whereas, in D1 to D4, a whole updated message is transferred (see especially 
D3, column 2, lines 46-55). 

However, such a feature is known in the art (see for instance D5, page 2, line 28 - 
page 3, line 12) so that a skilled person, aware of the teachings of D1-D4 and 
faced with the problem of reducing the flow of displayable data to be transferred 
from the peripheral device to the digital apparatus, would obviously implement that 
feature in the digital television apparatus disclosed in D1 to D4. 
Consequently, the claimed subject matter does not involve an inventive step. 

5. Claims 2-6, 8 and 9: 

These dependent claims do not appear to comprise any additional features that 
would render their subject-matter inventive over the available prior art. 
Therefore, these claims fail together with the independent claims for lack of 
inventive step. 

VI. Certain documents 

The following documents could become relevant in a further stage of prosecution 
of the present application: 

- EP-A-0 873 009 (SAMSUNG ELECTRONICS CO. LTD.) filed on 24.09.97 and 
published on 21.10.98, claiming a priority date of 14.04.97; and 

- EP-A-0 840 512 (TEXAS INSTRUMENTS INCORPORATED) filed on 03.1 1.97 
and published on 06.05.98, claiming a priority date of 01.11.96. 
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VII. Certain defects 

1 . The independent claims are not in the two-part form in accordance with Rule 
6.3(b) PCT, which in the present case would be appropriate, with those features 
known in combination from the prior art being placed in a preamble (Rule 6.3(b)(i) 
PCT) and with the remaining features being included in a characterising part (Rule 
6.3(b)(ii) PCT). 

2. The features of the claims are not provided with reference signs placed in 
parentheses (Rule 6.2(b) PCT). 

3. Corrections should be made: 

- on page 22, line 14 and page 24, line 8: "said" should read "the"; 

- on page 22, line 21: "overwritten" should read "overwritten"; 

- on page 23, lines 4 and 25: "said display device" and "said on-screen display" 
have no antecedent; 

- on page 24, line 7: "interconnected by a" should preferably read "via said". 



VIII. Certain observations 

1 . At the time being, it is not quite clear whether the independent claims are linked 
so as to form a single general inventive concept (Rule 13.1 PCT). 

2. Claim 10 is directed to a digital television apparatus comprising receiving steps 
so that it is not clear which claim category this claim should fall into. 
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Many of the devices may use a registry table that is built during a discovery 
process which looks at information stored in each instrument's Self Describing 
Device Table (SDDT). The SDDT may contain such information as a unique ID, 
5 node address, etc. The registry tables would be used by the DTV to build a menu 
to allow the user to set up connections between components (similar to the user 
selecting the composite input for the source of their TV today). The target device 
first checks the display format and the largest available block fields within the Self 
Description Device Table (SDDT) to see what size and resolution OSD can be 
10 handled. It then constructs the OSD data (header and bit-map) and stores it in its 
OSD memory area. 

As shown in Figure 4, an OSD menu 18 constructed on a display 14 consists of 
an OSD Region 20 and OSD Update Blocks 24 (OSDUB1 through OSDUB2). 

15 The data defining an OSD Region consists of a single color map contained in the 
Main OSD Header. Each OSD Update Block consists of an OSD Update Block 
Header and bit-map. The update blocks used to construct the OSD Menu are 
acquired from the target (e.g., VCR) by the display device to be used in 
constructing the OSD. The OSD Update Blocks are transferred from the target to 

20 the display device over the serial bus. 

Once the OSD information is ready for transfer, the target sends a trigger 
message to the display device (see Figure 5). These same trigger messages are 
used for both the main OSD Header as well as the OSD Update blocks 24. A 
25 unique trigger message is needed for each OSD Update Block 24. Initiation of an 
OSD Update Block transfer can only occur through the use of a trigger message 
from a target to the display device. A queue may be implemented in the display 
device so that trigger messages are processed in the same order in which they 
are received. 

30 

The trigger messages 22 will be processed in the order in which they are sent out, so . 
it is important for the target to know which OSD Update Block belongs on the bottom 
and which one belongs on the top. For example, a trigger message for OSD Block 0 
(the Main OSD Header and Palette) is sent out first, followed by the trigger message 
for OSD Block 1 , etc. Effectively, the first update block ends up on the 
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640X480 by specifying vertical line doubling and horizontal half resolution. If only 
4 bit color is used, then the amount of data that needs to be transferred is 
approximately 39 Kbytes. Assuming a 512 byte payload every 500 usee, this 
OSD could be transferred in about 40 msec. Small updates would of course take 
5 much less time. 



Real-time encoded video may be achieved by transferring bit-mapped OSD 
menus. In this case, a 640X480 display using 8 bit color could be transferred at 
* 30 frames/second using a 74 Mbit/second Isochronous channel. Probably one 
10 such channel could be supported on the cluster. 



In addition to the starting location and size of the current OSD data to be 
transferred to a display device, a field indicating the type of the OSD data may be 
useful. For example, a user watching a movie may want to ignore status or error 
15 messages. The differentiation of the type of OSD data is helpful for the display 
device and/or user to decide whether the message should be displayed. 

The trigger message can also be used to inform the display device to read the 
Main OSD Header and color palette. Additionally, the trigger message will also 
20 be able to inform the display device to clear the OSD. Initiation of an OSD 

Update Block read can only occur through the use of a trigger message from a 
target to the display device. The display device should process the trigger 
messages in the same order as received. 

Figure 6 illustrates the use of a sub-region message 30 generated by the display 
device 14 for requesting the update of a specific sub-region 32 of the existing OSD 
Region 20 being displayed. This message may be useful in several situations such 
as when an error message from the display device or from some other device 
overwrites a portion of the existing OSD. The display device can request that this 
sub-region of the OSD be re-transmitted. Such a sub-region message would be 
useful when there is a change to the color map, but the display device did not save 
copies of the original OSD Update Bitmaps. Still another benefit of using a sub- 
region message would be when the user selects a different device and then comes 
back to the earlier device. The display device may need to 
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Claims 



1 . A digital apparatus comprising: 

(a) means for receiving from a peripheral device, interconnected by a 
digital bus, bit-mapped data representative of an on-screen display associated with 
said peripheral device; 

(b) means for receiving a digital stream representative of a programmed 
event; and 

(c) means for combining, in said digital apparatus, said bit-mapped data 
received from said peripheral device and said digital stream to produce a signal 
representative of a combined displayable image. 

2. The digital apparatus of claim 1 further comprising: 

(a) means for receiving subsequent bit-mapped data representative of an 
updated portion of said previously received data; and 

(b) means for updating said combined displayable image with said 
received subsequent bit-mapped data to produce an updated combined displayable 
image, said updated combined displayable image being associated with said 
peripheral device. 

3. The digital apparatus of claim 2 wherein a portion of said combined 
displayable image is overwrititen, said digital apparatus further comprising : 

(a) means for requesting from said peripheral device said bit-mapped data 
corresponding to said overwritten portion of said combined displayable image; and 

(b) means for receiving from said peripheral device said bit-mapped data. 

4. The digital apparatus of claim 3 further comprising: 

means for selecting said peripheral device from a plurality of available 
peripheral devices interconnected by said digital bus. 
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5. The digital apparatus of claim 4 further comprising: 

means for notifying said peripheral device of a format change in said display 
5 device in response to a format change of said received digital stream. 

6. The digital apparatus of claim 5 further comprising: 

means for shifting said bit-mapped data within said combined displayable 

image. 



7. A method for managing an on-screen display menu of a peripheral device 
interconnected to a display device via a digital bus, the display device performing the 
steps of: 

(a) receiving, from said peripheral device, a message indicative of the 

15 characteristics of a block of bit-mapped data stored in a memory device associated 
with said peripheral device, said bit-mapped data being associated with an on-screen 
display menu of said peripheral device; 

(b) generating and providing asynchronous read request command to said 
peripheral device; 

20 (c) receiving, in response to said asynchronous read request command, 

said bit-mapped data from said peripheral device; 

(d) receiving a digital stream representative of a programmed event; and 

(e) combining said bit-mapped data received from said peripheral 
device and said digital stream to produce a combined displayable image, said 

25 combined image being representative of said on-screen display associated with 
said peripheral device. 

8. The method of claim 7 wherein said message contains the location and 
size of said block of bit-mapped data stored in said memory device. 

30 

9. The method of claim 8 wherein said data comprises a header and a bit- 
mapped update block, said header defining the parameters of said on-screen 
display menu and said bit-mapped update block defining the location and content 
of said menu. 
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10. A digital television apparatus comprising: 

(a) receiving from a peripheral device, interconnected by a digital bus, bit- 
5 mapped data representative of an on-screen display associated with said peripheral 

device; and 

(b) receiving from said peripheral device, interconnected by a digital bus, 
subsequent bit-mapped data representative of an updated portion of said previously 
transferred bit-mapped data, said subsequent bit-mapped data being indexed into 

10 said previously transferred bit-mapped data. 
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I. Basis of the report 

1 . This report has been drawn on the basis of (substitute sheets which have been furnished to the receiving Office in 
response to an invitation under Article 14 are referred to in this report as "originally filed" and are not annexed to 
the report since they do not contain amendments.): 

Description, pages: 

1-5,7,8,10-21 as originally filed 

6,9 as received on 15/11/1999 with letter of 11/11/1999 

Claims, No.: 

1-10 asreceivedon 15/11/1999 withletterof 11/11/1999 

Drawings, sheets: 

1/6-6/6 as originally filed 

2. The amendments have resulted in the cancellation of: 

□ the description, pages: 

□ the claims, Nos.: 

□ the drawings, sheets: 

3. □ This report has been established as if (some of) the amendments had not been made, since they have been 

considered to go beyond the disclosure as filed (Rule 70.2(c)): 

4. Additional observations, if necessary: 
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V. Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial 
applicability; citations and explanations supporting such statement 

1. Statement 



Novelty (N) 


Yes: 


Claims 


1-10 




No: 


Claims 




Inventive step (IS) 


Yes: 


Claims 






No: 


Claims 


1-10 


Industrial applicability (IA) 


Yes: 


Claims 


1-10 




No: 


Claims 





2. Citations and explanations 
see separate sheet 

VI. Certain documents cited 

1 . Certain published documents (Rule 70.10) 
and / or 

2. Non-written disclosures (Rule 70.9) 
see separate sheet 

VII. Certain defects in the international application 

The following defects in the form or contents of the international application have been noted: 
see separate sheet 

VIII. Certain observations on the international application 

The following observations on the clarity of the claims, description, and drawings or on the question whether the 
claims are fully supported by the description, are made: 

see separate sheet 
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V. Reasoned statement 

1 . Reference is made to the following documents: 

D1 : US-A-5 608 730 (OSAKABE Y. ET AL) 4 March 1 997 
D2: US-A-5 617 330 (STIRLING A.) 1 April 1997 
D3: US-A-5 499 018 (WELMER H.) 12 March 1996 
D4: US-A-5 617 571 (TANAKA S.) 1 April 1997 

D5: WO 97 05743 A (THOMSON CONSUMER ELECTRONICS INC.) 13 
February 1997 

2. Claim 1: 

Document D1 discloses a digital apparatus (10) comprising: 

(a) means for receiving (14) from a peripheral device (20), interconnected by a 
digital bus (1), data representative of an on-screen display associated with said 
peripheral device (see column 1, lines 7-16 and column 10, lines 4-11); 

(b) means for receiving (10a) a stream representative of a programmed event 
(see column 10, lines 20-26); and 

(c) means for combining (12), in said digital apparatus, said data received from 
said peripheral device and said stream to produce a signal representative of a 
combined displayable image (see column 18, lines 57-62). 

Similar prior art is also disclosed in D2 through D4. 

The claimed subject matter only differs from the disclosure of D1 to D4 in that the 
data is a bit-mapped data and in that the stream representative of a programmed 
event is a digital stream. Although not explicitly mentioned in any of documents 
D1-D4, these features nevertheless appear to be well known alternatives in the 
era of digital television. Besides, D1 refers to a "Data Attribute [...] for identifying 
ASCII code, [...] Japanese OSD data, [...] or the like" (see col. 13, lines 49-61) so 
that the use of bit-mapped data seems to be contemplated, which bit-mapped 
data is then to be combined with the digital stream in a straightforward way. 
Consequently, the subject matter of claim 1 is considered to lack an inventive 
step. 

3. Claim 7: 

Since it is also well known for a person skilled in the art of digital buses to use 
either of an asynchronous or an isochronous transfer mode, the same objection 
as to lack of inventive step likewise applies to this corresponding method claim. 
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4. Claim 10: 

As discussed earlier, document D1 indeed discloses a digital television apparatus 
(10) comprising: 

(a) means for receiving from a peripheral device (20), interconnected by a 
digital bus (1), data representative of an on-screen display associated with said 
peripheral device. 

Similar prior art is disclosed in D2 to D4. 

The subject matter of claim 10 further differs from the disclosure of D1 to D4 in 
that, in claim 10, data representative of an updated portion of the previously 
transferred data is transferred and indexed to said previously transferred data, 
whereas, in D1 to D4, a whole updated message is transferred (see especially 
D3, column 2, lines 46-55). 

However, such a feature is known in the art (see for instance D5, page 2, line 28 - 
page 3, line 12) so that a skilled person, aware of the teachings of D1-D4 and 
faced with the problem of reducing the flow of displayable data to be transferred 
from the peripheral devicejo the digital apparatus, would obviously implement that 
feature in the digital television apparatus disclosed in D1 to D4. 
Consequently, the claimed subject matter does not involve an inventive step. 

5. Claims 2-6, 8 and 9: 

These dependent claims do not appear to comprise any additional features that 
would render their subject-matter inventive over the available prior art. 
Therefore, these claims fail together with the independent claims for lack of 
inventive step. 



VI. Certain documents 

The following documents could become relevant in a further stage of prosecution 
of the present application: 

- EP-A-0 873 009 (SAMSUNG ELECTRONICS CO. LTD.) filed on 24.09.97 and 
published on 21.10.98, claiming a priority date of 14.04.97; and 

- EP-A-0 840 512 (TEXAS INSTRUMENTS INCORPORATED) filed on 03.11.97 
and published on 06.05.98, claiming a priority date of 01 .1 1 .96. 
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VII. Certain defects 

1. The independent claims are not in the two-part form in accordance with Rule 
6.3(b) PCT, which in the present case would be appropriate, with those features 
known in combination from the prior art being placed in a preamble (Rule 6.3(b)(i) 
PCT) and with the remaining features being included in a characterising part (Rule 
6.3(b)(ii) PCT). 

2. The features of the claims are not provided with reference signs placed in 
parentheses (Rule 6.2(b) PCT). 

3. Corrections should be made: 

- on page 22, line 14 and page 24, line 8: "said" should read "the"; 

- on page 22, line 21: "overwrititen" should read "overwritten"; 

- on page 23, lines 4 and 25: "said display device" and "said on-screen display" 
have no antecedent; 

- on page 24, line 7: "interconnected by a" should preferably read "via said". 



VIII. Certain observations 

1. At the time being, it is not quite clear whether the independent claims are linked 
so as to form a single general inventive concept (Rule 13.1 PCT). 

2. Claim 10 is directed to a digital television apparatus comprising receiving steps 
so that it is not clear which claim category this claim should fall into. 
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Many of the devices may use a registry table that is built during a 
discovery process which looks at information stored in each 
instrument's Self Describing Device Table (SDDT) . The SDDT may 
contain such information as a unique ID, node address, etc. The 
registry tables would be used by the DTV to build a menu to allow the 
user to set up connections between components (similar to the user 
selecting the composite input for the source of their TV today). The 
target device first checks the display format and the largest available 
block fields within the Self Description Device Table (SDDT) to see 
what size and resolution OSD can be handled. It then constructs the 
OSD data (header and bit-map) and stores it in its OSD memory area. 

As shown in Figure 4, an OSD menu 18 constructed on a display 14 
consists of an OSD Region 20 and OSD Update Blocks 24 (OSDUB1 
through OSDUB2). The data defining an OSD Region consists of a single 
color map contained in the Main OSD Header. Each OSD Update Block 
consists of an OSD Update Block Header and bit-map. The update 
blocks used to construct the OSD Menu are acquired from the target 
(e.g., VCR) by the display device to be used in constructing the OSD. 
The OSD Update Blocks are transferred from the target to the display 
device over the serial bus. 



Once the OSD information is ready for transfer, the target sends a 
trigger message 22 to the display device (see Figure 5). These same 
trigger messages are used for both the main OSD Header 23 as well as 
the OSD Update blocks 24. A unique trigger message 22 is needed for 
each OSD Update Block 24. Initiation of an OSD Update Block transfer 
can only occur through the use of a trigger message from a target to 
the display device. A queue may be implemented in the display 
device so that trigger messages are processed in the same order in 
which they are received. 

The trigger messages 22 will be processed in the order in which they 
are sent out, so it is important for the target to know which OSD 
Update Block belongs on the bottom and which one belongs on the 
top. For example, a trigger message for OSD Block 0 (the Main OSD 
Header and Palette) is sent out first, followed by the trigger message 
for OSD Block 1, etc. Effectively, the first update block ends up on the 
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640X480 by specifying vertical line doubling and horizontal half 
resolution. If only 4 bit color is used, then the amount of data that 
needs to be transferred is approximately 39 Kbytes. Assuming a 512 
byte payload every 500 usee, this OSD could be transferred in about 
40 msec. Small updates would of course take much less time. 

Real-time encoded video may be achieved by transferring bit- 
mapped OSD menus. In this case, a 640X480 display using 8 bit color 
could be transferred at 30 frames/second using a 74 Mbit/second 
Isochronous channel. Probably one such channel could be supported 
on the cluster. 

In addition to the starting location and size of the current OSD data to 
be transferred to a display device, a field indicating the type of the 
OSD data may be useful. For example, a user watching a movie may 
want to ignore status or error messages. The differentiation of the 
type of OSD data is helpful for the display device and/or user to 
decide whether the message should be displayed. 

The trigger message can also be used to inform the display device to 
read the Main OSD Header and color palette. Additionally, the trigger 
message will also be able to inform the display device to clear the 
OSD. Initiation of an OSD Update Block read can only occur through 
the use of a trigger message from a target to the display device. The 
display device shoulsages in the same order as received. 

Figure 6 illustrates the use of a sub-region message 30 generated by 
the display device 14 for requesting the update of a specific sub- 
region 32 of the existing OSD Region 20 being displayed. This 
message may be useful in several situations such as when an error 
message from the display device or from some other device 
overwrites a portion of the existing OSD. The display device can 
request that this sub-region of the OSD be re-transmitted. Such a 
sub-region message would be useful when there is a change to the 
color map, but the display device did not save copies of the original 
OSD Update Bitmaps. Still another benefit of using a sub-region 
message would be when the user selects a different device and then 
comes back to the earlier device. The display device may need to 
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Claims 

1. A digital apparatus comprising: 

(a) means for receiving from a peripheral device, interconnected 
by a digital bus, displayable digital data representative of an on-screen 
display associated with said peripheral device; 

(b) means for receiving a digital stream representative of a 
programmed event; and 

(c) means for combining, in said digital apparatus, said 
displayable data received from said peripheral device and said digital 
stream to produce a signal representative of a combined displayable 
image. 

2. The digital apparatus of claim 1 further comprising: 

(a) means for receiving subsequent displayable digital data 
representative of an updated portion of said previously received data; 
and 

(b) means for updating said combined displayable image with 
said received subsequent displayable data to produce an updated 
combined displayable image, said updated combined displayable image 
being associated with said peripheral device. 

3. The digital apparatus of claim 2 wherein a portion of said 
combined displayable image is overwrititen, said digital apparatus 
further comprising : 

(a) means for requesting from said peripheral device said 
displayable data corresponding to said overwritten portion of said 
combined displayable image; and 

(b) means for receiving from said peripheral device said 
displayable data. 

4. The digital apparatus of claim 3 wherein said displayable data is 
bit-mapped data. 

5. The digital apparatus of claim 4 further comprising: 

means for selecting said peripheral device from a plurality of 
available peripheral devices interconnected by said digital bus. 
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6. The digital apparatus of claim 5 further comprising: 

means for notifying said peripheral device of a format change in 
said display device in response to a format change of said received 
digital stream. 

7. The digital apparatus of claim 6 further comprising: 

means for shifting said displayable data within said combined 
displayable image. 

8. A method for managing an on-screen display menu of a peripheral 
device interconnected to a display device via a digital bus, the display 
device performing the steps of: 

(a) receiving, from said peripheral device, a message indicative 
of the characteristics of a block of data stored in a memory device 
associated with said peripheral device, said data being associated with 
an on-screen display menu of said peripheral device; 

(b) generating and providing asynchronous read request 
command to said peripheral device; 

(c) receiving, in response to said asynchronous read request 
command, said data from said peripheral device; 

(d) receiving a digital stream representative of a programmed 
event; and 

(e) combining said data received from said peripheral device 
and said digital stream to produce a combined displayable image, said 
combined image being representative of said on-screen display 
associated with said peripheral device. 

9. The method of claim 8 wherein said message contains the 
location and size of said block of bit-mapped data stored in said 
memory device. 

.10. The method of claim 9 wherein said data comprises a header 
and a bit-mapped update block, said header defining the parameters 
of said on-screen display menu and said bit-mapped update block 
defining the location and content of said menu. 
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11. A digital apparatus comprising: 

(a) transferring from a peripheral device to a display device 
interconnected by a digital bus, displayable digital data representative of 
an on-screen display associated with said peripheral device; and 

(b) transferring from said peripheral device to said display 
device, interconnected by a digital bus, subsequent displayable digital 
data representative of an updated portion of said previously transferred 
displayable data, said subsequent displayable data being indexed into 
said previously transferred displayable data. 
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DEVICE INTEROPERABILITY UTILIZING BIT-MAPPED 
ON-SCREEN DISPLAY MENUS 

Field of the Invention 

The invention involves a system for controlling multiple electronic 
devices, such as consumer electronic devices or the like, via 
interconnections such as digital data buses. More particularly, this 
invention concerns an arrangement for managing the interoperability 
of the On-Screen Display menus of such devices. 

Rarkf rround of the Invention 

A data bus can be utilized for interconnecting digital electronic 
devices such as television receivers, display devices, video-cassette 
recorders (VCR), direct broadcast satellite (DBS) receivers, and home 
control devices (e.g., a security system or a temperature control 
device). Communication using a d&ta bus occurs in accordance with a 
bus protocol. Examples of bus protocols include the Consumer 
Electronics Bus (CEBus) and the IEEE 1394 High Performance Serial 
Bus. 

A bus protocol typically provides for communicating both control 
information and data. For example, CEBus control information is 
communicated on a "control channel" having a protocol defined in 
Electronics Industries Association (EIA) specification IS-60. On an 
IEEE 1394 serial bus, control information is generally passed using the 
asynchronous services of the serial bus. Control information for a 
particular application can be defined using for example, Common 
Application Language (CAL) or AV/C. 

In today's analog audio/video (A/V) cluster, controlling peripheral 
devices may include, but do not require, the activation of an On- 
Screen Display (OSD) mechanism on a display device (i.e., TV). The 
OSD of such A/V devices is generated in the peripheral or target 
device (e.g., VCR) and is output on the NTSC output of such devices 
the same way as any other video signal. Thus, no additional 
hardware or software is needed in either the peripheral or the 
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display device. Figure 1 illustrates a present A/V system 10 having a 
VCR 12 and a display device 14 (e.g., television) that employs such a 
control methodology. Menus associated with controlling VCR 12 are 
generated by the VCR 12 and are provided to the display device 14 
5 via the NTSC output of the VCR 12 as a composite video signal. 

Summary of the Invention 

Unfortunately, to use the same approach (See Figure 2) with a digital 
10 TV (DTV) as a display device 12 is not practical since it would require 
the menus to be transported as MPEG-2 transport streams. Generation 
of such streams necessitates integrating an MPEG encoder 15 into all 
peripheral devices which greatly increases the cost and complexity of 
such consumer electronic devices. 

15 

The present invention provides for exchanging on-screen display 
(OSD) menus and associated control between common consumer 
electronic (CE) devices interconnected via a digital serial bus. The 
serial bus is used for the physical and link layers; a control language 

20 for managing OSDs and controlling the connectivity of devices 

interconnected via the bus. Particularly, this invention provides for 
transferring bit-mapped OSDs which are created and controlled by the 
target device to a display device and combining the bit-mapped OSDs 
with a digital video stream received by the display device. In the 

25 preferred embodiment, the transfer of the bit-mapped OSD menu is 
managed by trigger messages sent from the target to the display 
device. 

The present invention permits the selection of a target or source 
30 device (e.g., DVCR) for the display device (e.g., DTV), thereby allowing 
the target device to display both content and an OSD on the display 
device. Further, the user may select a source for the target device; 
this allows the chaining of devices so that for example, a program 
which is being decoded by a Cable STB may be viewed on a DTV and 
35 recorded on a DVHS recorder simultaneously. 

Another aspect of the present invention involves remote navigation; 
that is the device that is being controlled keeps track of the user's 
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navigation through the menu. For example, a VCR (i.e., target) makes 
its own changes to the OSD to move the highlight around with no 
participation from the display device (i.e., TV). This is accomplished 
utilizing OSD update blocks as described below. 

Brief Description of the Drawings 

The invention may be better understood by referring to the 
enclosed drawing in which: 

Figure 1 shows, in simplified block-diagram form, the 
interoperability of a prior art audio/video system; 

Figure 2 shows, in simplified block-diagram form, the 
interoperability of a digital VCR and a digital television; 

Figure 3 shows, in simplified schematic block-diagram form, the 
interoperability of digital devices employing the present invention 

Figure 4 shows, in simplified schematic block-diagram form, a 
display device having an on-screen display menu constructed using the 
present invention; 

Figure 5 shows, in simplified schematic form, the display device's 
construction of the on-screen display menu of Figure 4; 

Figure 6 shows, in simplified schematic form, the modification of 
the on-screen menu of Figure 4; and 

Figure 7 shows, in simplified schematic block diagram form, the 
pixel mapping for different resolutions of on-screen display menus of 
the present invention. 

In the drawing, reference numerals that are identical in different 
figures indicate features that are the same or similar. 
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Detailed Description of the Drawings 

The use of IEEE 1394 serial bus has been suggested for many 
5 applications within a Home Network environment. It is being 

discussed within Video Electronics Standards Association (VESA) for 
use as a "whole home network." It is being built into the next 
generation PCs and will be used for many local peripherals including 
disc drives. Further, digital audio/video consumer electronic devices 
10 such as digital televisions (DTVs) and digital video cassette recorders 
(DVHS) may utilize a serial bus for interconnecting these devices. 

IEEE- 13 94 is a high speed, low cost digital serial bus developed for 
use as a peripheral or back-plane bus. Some of the highlights of the 

15 bus include: dynamic node address assignments, data rates of 100, 
200, and 400 Mbits/sec, asynchronous and isochronous modes, fair 
bus arbitration, and consistency with ISO/IEC 13213. Co-pending 
applications; Attorney Docket Numbers 88,761 and 88,823 discuss the 
use of IEEE- 13 94 serial bus for interoperability of audio/ visual 

20 devices. 

Transferring On Screen Display Menus (OSDs) from a target (i.e., 
device to be controlled) to a display device (e.g., DTV ) can be 
achieved using one of several formats. For example, a subset of HTML 

25 without the navigation features may be used to describe the OSD. 

Another possibility is to transfer a run-length-encoded version of the 
menu using something similar to the DVD subpicture format. 
However, the preferred embodiment involves transferring the actual 
information in an OSD bit-map format. For example, an 8 bit/pixel, 

30 full screen, 640X480 OSD can be transferred in about 100 msecs 

utilizing 10% of the bandwidth of the 200 Mbit/sec IEEE 1394 serial 
bus. 

A bit-map format for the OSD description allows ( 1 ) the manufacturer 
35 to maintain the "look and feel" of the OSD, (2) for freedom in the 

generation of the OSD and (3) for dynamic updates (i.e. partial screen 
or even single pixel updates are possible). Compared to compressed 
representations, the bit-map representation requires less processing 
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time to display because displaying such bit-mapped OSD menus 
requires minimal interpretation and manipulation. Descriptive 
approaches, such as HTML, have a disadvantage of being difficult to 
specify and upgrade for typical consumer products. 

To simplify the transfer of bit-mapped OSD information, a "Pull" 
method is preferably utilized. With this method, the bulk of the OSD 
data is transferred from the target or peripheral device to a display 
device by asynchronous read requests issued by the display device. 
That is, the display device reads the OSD information from the 
memory of the peripheral device by making use of at least one block 
read transaction of IEEE 1394. The display device is informed of the 
location and size of the OSD data via a "trigger" command which is 
sent from the peripheral device to the display device when the 
peripheral device is ready to begin transferring data. 

Other alternatives for transferring an OSD menu from a peripheral 
device to a display device include; (1) an asynchronous push method 
which primarily uses IEEE 1394 asynchronous write transactions 
initiated by the peripheral device to write the OSD data into the 
display device, (2) an isochronous transport method for broadcasting 
the OSD data over one of the isochronous channels provided by IEEE 
1394, (3) an asynchronous stream method for carrying the OSD 
information and (4) Alternately, the bit-mapped OSD could be 
provided via a 8 VSB-T( trellis) or 16 VSB RF remodulated channel. 

Figure 3 defines a system 10 for providing interoperability between 
digital A/V devices interconnected via an IEEE 1394 serial bus. In 
such a system 10, interoperability may be achieved by transferring 
the on-screen display (OSD) menu directly from the peripheral or 
target device 12 (e.g., DVCR) to display device 14 (e.g., DTV) utilizing 
the "Pull" method. The menu is not transferred as a composite video 
stream which would require first passing the menu information 
through a MPEG encoder contained in the peripheral device. The 
menu is transferred as a bit-mapped OSD via serial bus 16 to DTV 14 
where the menu information may be overlayed in DTV 14 with the 
decoded MPEG stream prior to being displayed. 
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Many of the devices may use a registry table that is built during a 
discovery process which looks at information stored in each 
instrument's Self Describing Device Table (SDDT). The SDDT may 
contain such information as a unique ID, node address, etc. The 
registry tables would be used by the DTV to build a menu to allow the 
user to set up connections between components (similar to the user 
selecting the composite input for the source of their TV today). The 
target device first checks the display format and the largest available 
block fields within the Self Description Device Table (SDDT) to see 
what size and resolution OSD can be handled. It then constructs the 
OSD data (header and bit-map) and stores it in its OSD memory area. 

As shown in Figure 4, an OSD menu 18 constructed on a display 14 
consists of an OSD Region 20 and OSD Update Blocks 24 (OSDUB1 
through OSDUB2). The data defining an OSD Region consists of a single 
color map contained in the Main OSD Header. Each OSD Update Block 
consists of an OSD Update Block Header and bit-map. The update 
blocks used to construct the OSD Menu are acquired from the target 
(e.g., VCR) by the display device to be used in constructing the OSD. 
The OSD Update Blocks are transferred from the target to the display 
device over the serial bus. 

Once the OSD information is ready for transfer, the target sends a 
trigger message 22 to the display device (see Figure 5). These same 
trigger messages are used for both the main OSD Header 23 as well as 
the OSD Update blocks 24. A unique trigger message 22 is needed for 
each OSD Update Block 24. Initiation of an OSD Update Block transfer 
can only occur through the use of a trigger message from a target to 
the display device. A queue may be implemented in the display 
device so that trigger messages are processed in the same order in 
which they are received. 

The trigger messages 22 will be processed in the order in which they 
are sent out, so it is important for the target to know which OSD 
Update Block belongs on the bottom and which one belongs on the 
top. For example, a trigger message for OSD Block 0 (the Main OSD 
Header and Palette) is sent out first, followed by the trigger message 
for OSD Block 1, etc. Effectively, the first update block ends up on the 
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bottom and the last update block on the top. (That is, an OSD Menu 
may be constructed in steps where each subsequent step may 
overwrite a portion of a previous step.) This allows for OSD blocks to 
be constructed on the fly thereby keeping memory requirements low. 

5 

The bit map immediately follows the header for each OSD block. The 
OSD pixels that are stored in memory are a 4:4:4 representation of 
chroma/luma levels set from palettes. Each palette entry contains a 
transparency (T) bit, a blending (B) bit, 6 bits of Y, 4 bits of Cb, and 4 
10 bits of Cr. The transparency bit and the blending bit for each entry 
allow the target to selectively display either an OSD pixel, a video 
pixel, or a blended pixel on a pixel and pixel basis. 

After a trigger message is received from the target, the OSD module in 

15 the display device requests memory accesses (i.e., asynchronous 
reads) starting at the memory location specified in the trigger 
message. If the OSD is entirely new, the first trigger message should 
refer to the Main OSD Header and Palette. Once the display device has 
this information, it then requests information specified in the second 

20 trigger message (i.e., OSD Update Block 1). The display device reads 
all of the information associated with OSD Block 1 and begins to 
construct the actual bit-map image. At the same time, it informs the 
target that the block has been read so that the target may free up any 
memory it had allocated to the transfer of this data block. This image 

25 is then displayed. If additional trigger messages have been received, 
then those OSD Update Blocks are processed in the same way. The 
display device's OSD controller (not shown) uses this data to construct 
the OSD and mix it with the decoded MPEG video in DTV 14. The OSD 
Update Blocks stay on the screen until they are overwritten, cleared, 

30 or the user selects a different device. 

Before a color component is displayed, it is "left justified" by the OSD 
Controller (i.e., the least significant bits being padded with zeros) to 
produce 8 bits each of Y, Cb, and Cr. The 4:4:4 representations will be 
35 muxed into 4:2:2 MPEG video output by the display controller internal 
to the display device. 
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After receiving the pixel data for block 1, the OSD module reads the 
header for block 2, obtains the necessary information and then reads 
the pixel data associated with block 2. The OSD module repeats this 
5 process (read header, request data using the address, get pixel data, 
etc.) up through the point that the DTV selects a different source. 
This data is then stored in the proper format internal to the display 
device. The Display device's OSD controller uses this data to construct 
the OSD and mix it with the decoded MPEG video. 

10 

Updates occur in exactly the same way that the original OSD is built 
with the exception that there would be no need to transfer the Main 
OSD Header and color palette unless the color palette or spatial 
resolution has changed. Based on the input from a remote control 

15 (directly or indirectly), the target constructs the desired OSD Update 
Block(s) in its memory. These blocks may be very small and will 
likely overlap with the OSD already being displayed. Once the 
block(s) are ready, the target sends out the appropriate trigger 
message(s). After the trigger message(s) is received from the target, 

20 the OSD module in the display device requests memory accesses 
starting at the memory location specified in the trigger message. 
These OSD Update Blocks are processed and overlaid over the existing 
OSD in the same order that the trigger messages were received. The 
display device again informs the target of a successful read so that 

25 the target can free up any internal memory that it has allocated to the 
block transfer. Exactly like the original OSD, these blocks stay on the 
display until overwritten. 

Various views may be constructed within the target and then 
30 properly displayed by the display device. When a change is made, 
the target determines how the displayed OSD is affected and sends 
the proper Update Blocks to the display device. This scheme reduces 
complexity and bus traffic compared to the display device being 
required to keep track of overlays. 

35 

The amount of data to be transferred can be reduced by using a 
limited number of colors, using vertical line doubling and horizontal 
half resolution. For example, a 320X240 OSD can be displayed in 
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640X480 by specifying vertical line doubling and horizontal half 
resolution. If only 4 bit color is used, then the amount of data that 
needs to be transferred is approximately 39 Kbytes. Assuming a 512 
byte payload every 500 usee, this OSD could be transferred in about 
5 40 msec. Small updates would of course take much less time. 

Real-time encoded video may be achieved by transferring bit- 
mapped OSD menus. In this case, a 640X480 display using 8 bit color 
could be transferred at 30 frames/second using a 74 Mbit/second 
10 Isochronous channel. Probably one such channel could be supported 
on the cluster. 

In addition to the starting location and size of the current OSD data to 
be transferred to a display device, a field indicating the type of the 
15 OSD data may be useful. For example, a user watching a movie may 
want to ignore status or error messages. The differentiation of the 
type of OSD data is helpful for the display device and/or user to 
decide whether the message should be displayed. 

20 The trigger message can also be used to inform the display device to 
read the Main OSD Header and color palette. Additionally, the trigger 
message will also be able to inform the display device to clear the 
OSD. Initiation of an OSD Update Block read can only occur through 
the use of a trigger message from a target to the display device. The 

25 display device shoulsages in the same order as received. 

Figure 6 illustrates the use of a sub-region message 30 generated by 
the display device 14 for requesting the update of a specific sub- 
region 32 of the existing OSD Region 20 being displayed. This 

30 message may be useful in several situations such as when an error 
message from the display device or from some other device 
overwrites a portion of the existing OSD. The display device can 
request that this sub-region of the OSD be re-transmitted. Such a 
sub-region message would be useful when there is a change to the 

35 color map, but the display device did not save copies of the original 
OSD Update Bitmaps. Still another benefit of using a sub-region 
message would be when the user selects a different device and then 
comes back to the earlier device. The display device may need to 
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request some information to rebuild the display. Although a sub- 
region is requested as a block, it is possible that the shape of the OSD 
which was previously within that sub-region is not rectangular in 
shape. For this reason, the target may transfer the information for 

5 this sub-region to the display device in multiple OSD Update Blocks. 
This message will include the row/column start coordinates and the 
width/height of the sub-region. Please note however, that the target 
does not need to wait for such a message to display an OSD. Most of 
the time, it will initiate changes to its OSD based on incoming remote 

10 control messages. Trigger messages will be used to initiate the 
transfer of the OSDUB in either case. 

The OSD menu may be displayed properly over any of the below ATSC 
Video Formats. 

15 



Picture Size 


Frame Rate 


Aspect ratio 


1920 X 1080 


60i 




30p 


24p 


16:9 




1280 X 720 




60p 


3 Op 


24p 


16:9 




704 X 480 


60i 


60p 


30p 


24p 


16:9 


4:3 


640 X 480 


60i 


60p 


30p 


24p 




4:3 


i = interlaced p= progressive 



The general format of OSD menus being transferred from a target 
device to a display device involves first transferring a main OSD 
Header and secondly transferring a color palette. The OSD menu can 

20 be partially updated by transferring an updated OSD Header and the 
related bit-mapped menu. The Main OSD Header contains control 
information for the color map and general control information such as 
resolution, size of OSD area required, etc. The color map can be in one 
of 4 formats (2 bit color, 4 bit color, 8 bit color, no color map ) and 

25 also includes facilities for blending with background video. 

Main OSD Header 

The main OSD header is used to set the format of the following OSD 
menu. For example, the following header contains information (i.e., 
30 size of 640 X 480 pixels) about the entire OSD Region and about the 
color palette. Changes to the Main OSD Header are communicated to 
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the display device through the use of the trigger messages from the 
target. The defined OSD region is only valid as long as a target has 
been chosen as a source for a display device. 



Main OSD Header Format 




TO 



BO 



8 


7 


6 


5 


4 


3 


2 


1 


0 




Verti 

cal 

line 

doub 

ling 


Resolu 

tion 

Mode 


Mix Weight 


Color 

resolu 

tion 


0 



OSD Region Height 



color 0 Y 



OSD Region width 



color 0 Cb 



color 0 Cr 



Tl 



Bl 



color 1 Y 



color 1 Cb 



color 1 Cr 



Tl 



B2 



color 2 Y 



color 2 Cb 



color 2 Cr 



73 



B3 



color 3 Y 



color 3 Cb 



color 3 Cr 



T4 



B4 



color 4 Y 



color 4 Cb 



color 4 Cr 



T5 



B5 



color 5 Y 



color 5 Cb 



color 5 Cr 



B6 



color 6 Y 



color 6 Cb 



color 6 Cr 



T7 



B7 



color 7 Y 



color 7 Cb 



color 7 Cr 



T8 



B8 



color 8 Y 



color 8 Cb 



color 8 Cr 



TO 



B9 



color 9 Y 



color 9 Cb 



color 9 Cr 



T10 



BIO 



color 10 Y 



color 10 Cb 



color 10 Cr 



Til 



Bll 



color 11Y 



color 11 Cb 



color 11 Cr 



T12 



B12 



color 12 Y 



color 12 Cb 



color 12 Cr 



T13 



B13 



color 13 Y 



color 13 Cb 



color 13 Cr 



T14 



B14 



color 14 Y 



color 14 Cb 



color 14 Cr 



T15 



B15 



color 15 Y 



color 15 Cb 



color 15 Cr 



The OSD Header field is used to distinguish the type of OSD Block 
which is being transferred from the target to the display device for 
example, Main OSD Header or Bit-map Update Block. 

10 

There is also the possibility to specify that each vertical line is 
doubled. For an interlaced display, this has the effect of specifying 
that even and odd fields be the same. When this mode is enabled, 
every line of the OSD is repeated once (i.e., duplicated). For example, 
is by setting the vertical enable bit to true and sending 5 lines of OSD 
data to the display device, the OSD would produce 10 lines on the 
display output. It is necessary, then, for the target to set the Block 
Height to correctly correspond to the total displayed OSD lines (in this 
case, 10). 



20 
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The mix weight bits tell the OSD the blending ratio for OSD and video. 
For example, each bit may have a resolution of 1/16. The blending 
ratio ranges from 0 (transparent) to 15/16 (pixel almost solid). The 
same mix weight is used for all pixels that have their respective 
5 blending bit set (B[n]=l). The mix weight is ignored for palettes with 
blending disabled, resulting in solid OSD. 

The OSD Region Height and OSD Region Width define the height and 
width of the OSD Region (in number of pixels) which the target plans 

10 to use. A typical region may be 640X480. The display device may 
not display portions of OSD Update Blocks which fall outside of this 
region. Color Resolution bits defines the current resolution of the OSD 
as, for example, full, half, or third resolution. The combination ofthe 
OSD Region Height, OSD Region Width and Color Resolution effectively 

i 5 set the OSD layout. 

The color palette immediately follows the Main OSD Header. Each 
palette entry contains a transparency (T) bit, a blending (B) bit, 6 bits 
of Y, 4 bits of Cb, and 4 bits of Cr. Note that each of these 3 color 

20 components will be converted to a byte before mixing with MPEG 
video. Therefore, the bits associated with each field (e.g., Y) can be 
considered the most significant bits within that byte. For example, for 
luminance (Y), the 6 bits in the color map are the 6 most significant 
bits in a luminance byte. The transparency bit and the blending bit 

25 for each entry allow the target to selectively display either an OSD 
pixel, a video pixel, or a blended pixel on a pixel by pixel basis. 
Changes to the Color Palette are communicated to the display device 
through the use of trigger messages and subsequent read operations. 

The OSD pixels that are stored in memory are a 4:4:4 representation 
30 of chroma/luma levels set from the palette. The values in the bit- 
map are essentially indexed into the palette. Note that the color 
resolution of each block may be less than that specified for the 
palette. For example, if there are 256 entries in the color map (i.e., 8 
bits/pixel), then a specific OSD block may specify 2 bits/pixel, 4 
35 bits/pixel, or 8 bits/pixel. If 2 bits/pixel are specified for the OSD 
block in this example, then these 2 bits would index into the first 4 
entries of the color map. If 4 bits/pixel are specified for the OSD 
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block, then these 4 bits would index into the first 16 entries of the 
color map. 

For the True Color Mode, the OSD hardware in the display device may 
extracts 4:2:2 data directly from the OSD FIFO (not shown), and send it 
5 out through the outputs, by-passing the normal palette look-up. All 
normal functions of the OSD are supported, except for the mixing 
function. Thus, the user may use this True Color mode in full, half, or 
third resolutions. Any pixel can be made transparent by setting its Y 
component to "0". Note that all data for the header block is assumed 

10 to be in 4:2:2 format in the following sequence: Yl, Cbl, Crl, Y2, Y3, 
Cb3, Cr3, Y4, ... Each component is 8 bits of data. In this format, both 
Yl and Y2 use the same Chroma components (Cbl, Crl). That is, each 
pixel is represented by a respective luma value and by a set of 
chroma information that is shared with a second pixel. For example, 

is pixels 1 and 2 are represented by respective luma values Yl and Y2 
and a common set of chroma values Cbl and Crl. This results in an 
effective pixel size of 16 bits/pixel. As in palette-based mode, only 
even numbers of pixels are supported for OSD Update Blocks. The 
pixel format of the update block may be configured such that the 

20 upper left pixel is first, followed in a logical manner across first and 
down second to the final pixel located at the bottom right of the 
region. Again, the user needs to properly calculate the number of 
pixels per line required for the given resolution and line width. 



True Color Bit-map Format 



pixel 1 - Y 


pixel 0&1 - Cr 


pixel 0&1 - Cb 


pixel 0 - Y 


pixel 3 - Y 


pixel 2&3 - Cr 


pixel 2&3 - Cb 


pixel 2 - Y 


Etc. 









25 

High resolution displays can have 4 to 6 times the pixel density for 
the same size OSD area. To ease setup requirements and OSD 
transmission times, half resolution and one-third resolution modes 
are provided. These modes are available for both palette based OSD 
30 and true-color OSD. Figure 7 illustrates how individual pixels may be 
mapped to output pixels based upon the selected resolution. 
It is important to realize that it is up to the target to properly set the 
width of the OSD Region based upon the resolution mode. The starting 
column and width in the OSD Update Block Header directly correspond 
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to output display pixels of the display device (based upon the internal 
display pixel counter). For example, if the column start position is 
100 and the width is 100, then the OSD Update will begin displaying 
pixels at pixel count 100 and end at pixel count 199. Thus, this 
5 function is not dependent upon the resolution mode selected. If the 
resolution is Half, and the target wants to display this same set of 
pixels, then it would have to adjust the width to 200. The effect 
would be to see a horizontally "stretched" version of the original OSD 
picture. 

10 

At a minimum, all display devices should be able to display a 
640x480 at 2 bits/pixel OSD using vertical line doubling and 1/2 or 
1/3 resolution mode for horizontal. For 1/3 horizontal mode, this 
would result in a 1920X1080 display with the resolution (and data 
is transfer time) of a 640X480 display. 

The transfer of data (i.e., bit-mapped menus) through the bus may be 
achieved in a reasonable amount of time. For example all the data 
required for a 640x480 OSD with 4 bits/pixel requires 1,228,800 bits. 

20 All of this data can be transferred in about 150 ms assuming a 100 
Mb/ sec bus, a packet payload of 512 Bytes and assuming that we can 
transmit one packet each SOOjisec. This time goes down even further 
when one takes into account that no OSD takes up this much space. 
Using only a quarter (typical) of the entire screen results in roughly 

25 40 ms transfer time. Small updates can be on the order of a few 
milliseconds. 

OSD Update Blocks 

An OSD Region is a defined area on the display screen. The region is 
30 filled using OSD Update Blocks (OSDUB) (See Figure 4). Each OSD 
Update Block defines a rectangular portion of the screen to be 
updated. Each block contains its own header information and bit- 
map. Each update block will remain on the screen until overwritten 
by another block or until a "Clear Region" trigger command is 
35 received. The target has full flexibility of the format of these blocks 
(taking into account the limitations of the display device). 



WO 99/27710 



15 



PCT/US98/24687 



The OSD Update Block's dimensions are absolute (in a pixel sense). Its 
coordinates are absolute within the OSD Region. The upper left hand 
corner of the OSD region is coordinate (0,0). The height/width of the 
displayed OSD Block will depend on the display format. If the 
transmission format changes, the OSD's appearance may change 
accordingly. If the transmission format changes, a message will be 
provided (see below discussion under Display Information) from the 
display device to the target letting the target know that the format 
has changed, allowing the target to re-specify the OSD if it desires. It 
is anticipated, that most OSDs will be mixed with the display format 
and will be unaffected by a transmission format change. However, 
the target may still want to redraw the OSD since the video may be 
occupying a different portion of the screen. 



The header for an OSD Update Block contains the start position within 
the OSD Region and the size of the block. The header (see below) 
contains two bits which designate the color resolution. This color 
resolution must be less than or equal to that specified in the Main OSD 
Header. 

OSD Update Block Header Format 




10 



0 



row start position 



block height 



column start position 



block width 



Shif 


Shift 


Sin 


t 


Directi 


gle 




an 


Col 






or 



Color 

Resoluti 

on 



Bit-map Information 



O 



etc 



The row start and the column start pointers define the upper left 
corner of the OSD Block which will be displayed. Outside of this box, 
no OSD will be displayed. Note that pixels are numbered in increasing 
order starting at 0. 



WO 99/27710 PCT/US98/24687 

16 



The block height and block width define the height and width of the 
OSD Block (in number of pixels) which will be displayed. Outside of 
this box, no OSD will be displayed. 

5 

A method for sending a single color update block has been provided. 
When single color is specified, only a single color is sent in the Update 
Block (as opposed to a bit-map of the specified region). The color is 
supplied in the format implied by the header. The Single Color (SC) 
io bit when set specifies that the entire OSD Update Block is a single 
color. In this case, the bit-map information will contain one color in 
the format specified by the Color Resolution bits. 

An Update Block can be used to shift pixels in the specified region up, 
15 down, right, or left. The data to be shifted in is supplied in the bit- 
map portion of the Update Block. For example, if a 200x100 region is 
specified by the Update Block, and shift right by 10 pixels is specified, 
then the bit-map supplied with the Update Block would be 10x100. A 
two bit field specifies the shift direction. 

20 

When asserted, the Shift bit specifies that the region specified by this 
Update Block be shifted in this specified direction by the specified 
number of pixels. The data that is to be shifted in is contained in the 
bit-map data portion of the Update Block. 

25 

When the shift bit is set, this 9 bit shift value field specifies the 
number of pixels by which the data is shifted. The size of the bit-map 
included in the Update Block is a function of this field and the 
dimension perpendicular to the shift direction. 

30 

Sub-region Request 

A sub-region message 30 has also been defined which allows the 
display device 14 to request a specific portion 32 of a region 20 which 
had been previously sent (see Figure 6). This would be useful if the 
35 OSD had to be temporarily overwritten for an error message from a 
different device or something similar. In this way, the display device 
can request the region when needed (again keeping memory 
requirements low). 
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OSD Sub-region Request Message Encapsulation 
< — 1 Byte — >< — 1 Byte — >< — 1 Byte — >< — 1 Byte — > 



fcp MMMMW 

CTS=lh M*fflWt 


APDU=E0h 


Context ID=90h??? 


Object ID = 03 h??? 


Method ID = 46h 


IV ID = 6Ch 


Delimiter = F5h 


Delimiter = F5h 


Data start = F4h 


Data length - 38h 


Escape = F6h 


OSD_sub- 
region_request 


OSD_sub-region_request 


OSD_sub-region_request 


End of 
Command=F9h 



1 Quadlet — » 



The field "OSD_sub-region_request" consists of the following 
information: 

Table 1 - OSD Trigger Message Format 



1 


SR Row 


1 


SR Column | SR Height | 


SR Width 


1 


4 




M — 


M M — 




» 



2 Bytes 2 Bytes 2 Byte 2 Bytes 

SR^Row: Number of row from the top (top row being 0 relative to 
the top of the Region requested by the target for OSD 
usage). 

SR_Column: Number of column from the left (left column being 0 

relative to the left of the Region requested by the target 
for OSD usage). 

SR_Height: Height of Subregion in number of rows (Must be less than 
the number of rows in the OSD Region). 

SR_Width: Width of Subregion in number of columns (Must be less 
than the number of columns in the OSD Region). 

If SR_Height = SR_Width = 0, then the request shall be interpreted as 
a request to resend the Main OSD Header and the color map. 

All targets capable of generating an OSD shall implement an OSD Sub- 
region Object as defined below. Display devices communicate the 
applicable sub-region by specifying the row/column coordinates of 



WO 99/27710 



PCT/US98/24687 



18 



the upper left corner of the region and the width and height. The 
message syntax which goes into a FCP frame as defined by IEC 61883 
is shown below. 

5 Display Information 

The following message has been defined to allow the display device to 
inform the target that the display format has changed. The display 
format (along with other information) will also be available to be read 
by the target at any time. The feedback provided from the display 

10 device to the target may consist of what the entire OSD bit-map plane 
is (usually the same as the display format) and what portion of the 
plane has overlapping video. For example, the OSD bit-map plane 
may be 1920X1080, but if the incoming video is 640X480 with a 4:3 
aspect ratio, then the resultant video may be displayed as 1280X960 

is with the upper left hand corner of the video at coordinate (319,59). 



Display Information 



< 1 Byte 


>< 


— 1 Byte --><- 


1 Byte — ><-- 


- 1 Byte — > 


FCPCTS=lh 




APDU=E0h 


Context=90h 


Object ID=04h 


Method ID = 


= 46h 


IV ID = 6Ch 


Delimiter = F5 


Delimiter = F5 


Data start= 


=F4h 


Data length=3 136h 


Escape=F6h . 


Bit-map Resolution/Location and Video Location 


Bit-map Resolution/Location and Video Location 


Bit-map Resolution/Location and Video Location 


Bit-map Resolution/Location and Video Location 


End ofCommand=F9h 




zero pad 





20 



I Quadlet 



Bit-map Resolution/Location and Video Location Field 



Horizontal full screen bit-map 
dimension (pixels) 


Vertical Full screen bit-map 
dimension (pixels) 


OSD Region starting column position 


OSD Region starting row position 


Width of Displayed Video (pixels) 


Height of Displayed Video (pixels) 


Video starting column position 


Video starting row position 



1 Quadlet 



Application Control Languag es 
25 In order for a consumer electronic device to interact with other 
devices interconnected via a IEEE 1394 serial bus, a common set of 
commands must be defined. Three standard approaches for device 
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modeling and control are C AL, AV/C and the approach adopted for the 
Universal Serial Bus (USB). 

The design of control languages is based on the assumption that all 

5 consumer electronic products have a hierarchical structure of common 
parts or functions. CAL and AV/C are control languages that 
distinguish between logical and physical entities. For example, a 
television (i.e., a physical entity) may have a number of functional 
components (i.e., logical entities) such as a tuner, audio amplifier, etc. 

10 Such control languages provide two main functions: Resource 
allocation and Control. Resource allocation is concerned with 
requesting, using and releasing Generic Network resources. Messages 
and control are transported by the FCP as defined in IEC-61883 and 
discussed above. For example, CAL has adopted an object base 

15 methodology for its command syntax. An object contains and has sole 
access to a set number of internal values known as instance variables 
(IV). Each object keeps an internal list of methods. A method is an 
action that an object takes as a result of receiving a message. When a 
method is invoked, one or more IVs are usually updated. A message 

20 may consist of a method identifier followed by zero or more 

parameters. When an object receives a method, it looks through its 
list of methods for one which matches the method identified in the 
message. If found, the method will be executed. The parameters 
supplied with the message determine the exact execution of the 

25 method. 

All devices that are capable of displaying OSDs must implement the 
following OSD object. This object assumes Asynchronous PULL with 
trigger message approach. This object would be carried in the trigger 
30 message from the target to the display device. The display device 
would then pull the menu by reading it from the target's bus mapped 
memory space. The response of this request will be used by the 
target device as an indication that the display device has read these 
update blocks. 
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OSD Update Trigger Object 





OSD Update Trigger Object 




(16) Data Memory 




The object is used for triggering the OSD mechanism in display capable 
devices. 




IV 


R/W 


Type 


Name 


Context Function 




a (61) 

b 
(62) 


R 
R 


Numeric 
Numeric 


size_of_block 

length_of 
_record 


size of " memory _block" in 
bytes (default value = 10) 
length of current_record in 
bytes (default value =10) 




C(43) 


R/W 


Numeric 


current 
_index 


current record block pointed 
to (default value = 0) 




K6C) 


R/W 


Data ( ) 


memory 
_block 


In each record, 6 MSBs 
contain the offset and LSB 
contains the OSD_type, 
remaining 3 bytes represent 
the length of OSD in bytes. 



All devices capable of generating the OSD must implement the 
following OSD Subregion Request Object. This object would be carried 
in the request message from the display device to the target for 
requesting a sub-region of the OSD with coordinates row and column, 
width and height. 



OSD Subregion Request Object 





OSD Sub-region Request Object \ (16) Data Memory 




The object is used for requesting a sub-region of the OSD, 




IV 


R/W 


Type 


Name 


Context Function 




a (61) 

b 
(62) 


R 
R 


Numeric 
Numeric 


size_of_block 

length_of 
_record 


size of "memory_block" in 
bytes (default value = 8) 

length of current_record in 
bytes (default value = 8) 




C(43) 


R/W 


Numeric 


current 
_index 


current record block pointed 
to (default value = 0) 




K6C) 


R/W 


Data (8) 


memory 
_block 


In each record, 2 MSBs 
contain the row coordinate, 
next two bytes the column 
coordinate, next two bytes 
the height and 2 LSBs the 
width of the sub-region. 



The following object is used for informing the target about the 
display. For example, the resolution and size of the OSD bit-map 
plane, and the location and size of the displayed video. 



SUBSTITUTE SHEET (RULE 26) 
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Display Information Object 





Display Information Object 




(16) Data Memory 




The object is used for informing the Target of the OSD and Display 
Format. 




IV 


R/W 


Type 


Name 


Context Function 




a (61) 

b 
(62) 


R 
R 


Numeric 
Numeric 


size_of_block 

length_of 
_record 


size of "memory_block" in 
bytes (default value = 16) 

length of current_record in 
bytes (default value =16) 




C(43) 


R/W 


Numeric 


current 
_index 


current record block pointed 
to (default value = 0) 




K6C) 


R/W 


Data (16) 


memory 
_block 


In each record, 4 MSBs 
contain the full screen bit- 
map dimensions, the next 4 
bytes contain the OSD 
Region's location, the next 4 
bytes contain the size of the 
displayed video, the last 4 
bytes contain the location of 
the displayed video. 



While the invention has been described in detail with respect to 
numerous embodiments thereof, it will be apparent that upon a 
5 reading and understanding of the foregoing, numerous alterations to 
the described embodiment will occur to those skilled in the art and it 
is intended to include such alterations within the scope of the 
appended claims. 
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Claims 

1. A digital apparatus comprising: 

(a) means for receiving from a peripheral device, interconnected 
by a digital bus, displayable digital data representative of an on-screen 

5 display associated with said peripheral device; 

(b) means for receiving a digital stream representative of a 
programmed event; and 

(c) means for combining, in said digital apparatus, said 
displayable data received from said peripheral device and said digital 

10 stream to produce a signal representative of a combined displayable 
image. 

2. The digital apparatus of claim 1 further comprising: 

(a) means for receiving subsequent displayable digital data 

is representative of an updated portion of said previously received data; 
and 

(b) means for updating said combined displayable image with 
said received subsequent displayable data to produce an updated 
combined displayable image, said updated combined displayable image 

20 being associated with said peripheral device. 

3. The digital apparatus of claim 2 wherein a portion of said 
combined displayable image is overwritten, said digital apparatus 
further comprising : 

25 (a) means for requesting from said peripheral device said 

displayable data corresponding to said overwritten portion of said 
combined displayable image; and 

(b) means for receiving from said peripheral device said 
displayable data. 

30 

4. The digital apparatus of claim 3 wherein said displayable data is 
bit-mapped data. 



35 



5. The digital apparatus of claim 4 further comprising: 

means for selecting said peripheral device from a plurality of 
available peripheral devices interconnected by said digital bus. 
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6. The digital apparatus of claim 5 further comprising: 

means for notifying said peripheral device of a format change in 
said display device in response to a format change of said received 
5 digital stream. 

7. The digital apparatus of claim 6 further comprising: 
means for shifting said displayable data within said combined 

displayable image. 

8. A method for managing an on-screen display menu of a peripheral 
device interconnected to a display device via a digital bus, the display 
device performing the steps of: 

(a) receiving, from said peripheral device, a message indicative 
of the characteristics of a block of data stored in a memory device 
associated with said peripheral device, said data being associated with 
an on-screen display menu of said peripheral device; 

(b) generating and providing asynchronous read request 
command to said peripheral device; 

(c) receiving, in response to said asynchronous read request 
command, said data from said peripheral device; 

(d) receiving a digital stream representative of a programmed 
event; and 

(e) combining said data received from said peripheral device 
and said digital stream to produce a combined displayable image, said 
combined image being representative of said on-screen display 
associated with said peripheral device. 

9. The method of claim 8 wherein said message contains the 
30 location and size of said block of bit-mapped data stored in said 

memory device. 

10. The method of claim 9 wherein said data comprises a header 
and a bit-mapped update block, said header defining the parameters 

35 of said on-screen display menu and said bit-mapped update block 
defining the location and content of said menu. 



15 



20 



WO 99/27710 



24 



PCT/US98/24687 



11. A digital apparatus comprising: 

(a) transferring from a peripheral device to a display device, 
interconnected by a digital bus, displayable digital data representative of 
an on-screen display associated with said peripheral device; and 

(b) transferring from said peripheral device to said display 
device, interconnected by a digital bus, subsequent displayable digital 
data representative of an updated portion of said previously transferred 
displayable data, said subsequent displayable data being indexed into 
said previously transferred displayable data. 
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